Pandas Profiling Report

Dataset statistics

Number of variables	11
Number of observations	608
Missing cells	40
Missing cells (%)	0.6%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	52.4 KiB
Average record size in memory	88.2 B

Variable types

NUM	8
CAT	3

Warnings

`Hand` has constant value "608"	Constant
`ASF` is highly correlated with `eTIV`	High correlation
`eTIV` is highly correlated with `ASF`	High correlation
`SES` has 38 (6.2%) missing values	Missing

Reproduction

Analysis started	2021-11-24 19:50:08.506179
Analysis finished	2021-11-24 19:50:33.883731
Duration	25.38 seconds
Software version	pandas-profiling v2.9.0
Download configuration	config.yaml

df_index
Real number (ℝ_≥0)

Distinct	399
Distinct (%)	65.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	194.84375
Minimum	0
Maximum	415
Zeros	2
Zeros (%)	0.3%
Memory size	4.8 KiB

Quantile statistics

Minimum	0
5-th percentile	19
Q1	97.75
median	196.5
Q3	290.25
95-th percentile	367.65
Maximum	415
Range	415
Interquartile range (IQR)	192.5

Descriptive statistics

Standard deviation	113.4730745
Coefficient of variation (CV)	0.5823798532
Kurtosis	-1.135586136
Mean	194.84375
Median Absolute Deviation (MAD)	96
Skewness	0.01724620701
Sum	118465
Variance	12876.13864
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2	0.3%
228	2	0.3%
243	2	0.3%
242	2	0.3%
241	2	0.3%
240	2	0.3%
239	2	0.3%
81	2	0.3%
236	2	0.3%
235	2	0.3%
Other values (389)	588	96.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2	0.3%
1	2	0.3%
2	2	0.3%
3	1	0.2%
4	1	0.2%

Value	Count	Frequency (%)
415	1	0.2%
414	1	0.2%
413	1	0.2%
412	1	0.2%
411	1	0.2%

M/F
Categorical

Distinct	2
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Memory size	4.8 KiB

F	369
M	239

Frequencies
Length

Value	Count	Frequency (%)
F	369	60.7%
M	239	39.3%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Hand
Categorical

CONSTANT
REJECTED

Distinct	1
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Memory size	4.8 KiB

R	608

Frequencies
Length

Value	Count	Frequency (%)
R	608	100.0%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Age
Real number (ℝ_≥0)

Distinct	54
Distinct (%)	8.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	75.20888158
Minimum	33
Maximum	98
Zeros	0
Zeros (%)	0.0%
Memory size	4.8 KiB

Quantile statistics

Minimum	33
5-th percentile	58
Q1	70
median	76
Q3	82
95-th percentile	90
Maximum	98
Range	65
Interquartile range (IQR)	12

Descriptive statistics

Standard deviation	9.86502584
Coefficient of variation (CV)	0.1311683625
Kurtosis	1.160860294
Mean	75.20888158
Median Absolute Deviation (MAD)	6
Skewness	-0.727201952
Sum	45727
Variance	97.31873483
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
73	40	6.6%
80	34	5.6%
78	32	5.3%
71	30	4.9%
75	30	4.9%
81	27	4.4%
77	23	3.8%
82	21	3.5%
74	21	3.5%
69	20	3.3%
Other values (44)	330	54.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
33	1	0.2%
39	1	0.2%
43	1	0.2%
45	1	0.2%
46	3	0.5%

Value	Count	Frequency (%)
98	1	0.2%
97	1	0.2%
96	2	0.3%
95	1	0.2%
94	2	0.3%

Educ
Real number (ℝ_≥0)

Distinct	17
Distinct (%)	2.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	10.18421053
Minimum	1
Maximum	23
Zeros	0
Zeros (%)	0.0%
Memory size	4.8 KiB

Quantile statistics

Minimum	1
5-th percentile	2
Q1	4
median	12
Q3	16
95-th percentile	18
Maximum	23
Range	22
Interquartile range (IQR)	12

Descriptive statistics

Standard deviation	6.058388118
Coefficient of variation (CV)	0.5948804871
Kurtosis	-1.460534697
Mean	10.18421053
Median Absolute Deviation (MAD)	6
Skewness	-0.1238958173
Sum	6192
Variance	36.70406659
Monotocity	Not monotonic

Histogram with fixed size bins (bins=17)

Value	Count	Frequency (%)
12	103	16.9%
16	81	13.3%
18	64	10.5%
2	64	10.5%
5	51	8.4%
4	50	8.2%
3	47	7.7%
14	33	5.4%
13	27	4.4%
1	23	3.8%
Other values (7)	65	10.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	23	3.8%
2	64	10.5%
3	47	7.7%
4	50	8.2%
5	51	8.4%

Value	Count	Frequency (%)
23	3	0.5%
20	13	2.1%
18	64	10.5%
17	9	1.5%
16	81	13.3%

SES
Real number (ℝ_≥0)

MISSING

Distinct	5
Distinct (%)	0.9%
Missing	38
Missing (%)	6.2%
Infinite	0
Infinite (%)	0.0%

Mean	2.471929825
Minimum	1
Maximum	5
Zeros	0
Zeros (%)	0.0%
Memory size	4.8 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	2
Q3	3
95-th percentile	4
Maximum	5
Range	4
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	1.128050153
Coefficient of variation (CV)	0.4563439228
Kurtosis	-1.101423586
Mean	2.471929825
Median Absolute Deviation (MAD)	1
Skewness	0.19902364
Sum	1409
Variance	1.272497148
Monotocity	Not monotonic

Histogram with fixed size bins (bins=5)

Value	Count	Frequency (%)
2	168	27.6%
1	138	22.7%
3	131	21.5%
4	123	20.2%
5	10	1.6%
(Missing)	38	6.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	138	22.7%
2	168	27.6%
3	131	21.5%
4	123	20.2%
5	10	1.6%

Value	Count	Frequency (%)
5	10	1.6%
4	123	20.2%
3	131	21.5%
2	168	27.6%
1	138	22.7%

MMSE
Real number (ℝ_≥0)

Distinct	19
Distinct (%)	3.1%
Missing	2
Missing (%)	0.3%
Infinite	0
Infinite (%)	0.0%

Mean	27.23432343
Minimum	4
Maximum	30
Zeros	0
Zeros (%)	0.0%
Memory size	4.8 KiB

Quantile statistics

Minimum	4
5-th percentile	20
Q1	26
median	29
Q3	30
95-th percentile	30
Maximum	30
Range	26
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	3.687980493
Coefficient of variation (CV)	0.1354166371
Kurtosis	5.235330036
Mean	27.23432343
Median Absolute Deviation (MAD)	1
Skewness	-2.0613576
Sum	16504
Variance	13.60120012
Monotocity	Not monotonic

Histogram with fixed size bins (bins=19)

Value	Count	Frequency (%)
30	183	30.1%
29	143	23.5%
28	74	12.2%
27	50	8.2%
26	37	6.1%
23	21	3.5%
21	17	2.8%
25	15	2.5%
20	14	2.3%
22	14	2.3%
Other values (9)	38	6.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
4	1	0.2%
7	1	0.2%
14	1	0.2%
15	6	1.0%
16	4	0.7%

Value	Count	Frequency (%)
30	183	30.1%
29	143	23.5%
28	74	12.2%
27	50	8.2%
26	37	6.1%

CDR
Categorical

Distinct	4
Distinct (%)	0.7%
Missing	0
Missing (%)	0.0%
Memory size	4.8 KiB

0	341
0.5	193
1	69
2	5

Frequencies
Length

Value	Count	Frequency (%)
0	341	56.1%
0.5	193	31.7%
1	69	11.3%
2	5	0.8%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	3
Median length	3
Mean length	3
Min length	3

eTIV
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	343
Distinct (%)	56.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1477.0625
Minimum	1106
Maximum	2004
Zeros	0
Zeros (%)	0.0%
Memory size	4.8 KiB

Quantile statistics

Minimum	1106
5-th percentile	1230
Q1	1352.5
median	1460
Q3	1569
95-th percentile	1800.55
Maximum	2004
Range	898
Interquartile range (IQR)	216.5

Descriptive statistics

Standard deviation	170.6537948
Coefficient of variation (CV)	0.1155359335
Kurtosis	-0.008311260658
Mean	1477.0625
Median Absolute Deviation (MAD)	109
Skewness	0.5450006412
Sum	898054
Variance	29122.71767
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1475	7	1.2%
1495	6	1.0%
1506	5	0.8%
1295	5	0.8%
1536	5	0.8%
1569	5	0.8%
1483	5	0.8%
1453	5	0.8%
1390	5	0.8%
1447	4	0.7%
Other values (333)	556	91.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1106	1	0.2%
1123	2	0.3%
1143	1	0.2%
1147	1	0.2%
1151	1	0.2%

Value	Count	Frequency (%)
2004	1	0.2%
1992	1	0.2%
1987	1	0.2%
1957	1	0.2%
1931	1	0.2%

nWBV
Real number (ℝ_≥0)

Distinct	176
Distinct (%)	28.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.7371299342
Minimum	0.644
Maximum	0.847
Zeros	0
Zeros (%)	0.0%
Memory size	4.8 KiB

Quantile statistics

Minimum	0.644
5-th percentile	0.67335
Q1	0.704
median	0.736
Q3	0.76625
95-th percentile	0.81465
Maximum	0.847
Range	0.203
Interquartile range (IQR)	0.06225

Descriptive statistics

Standard deviation	0.0426701987
Coefficient of variation (CV)	0.05788694329
Kurtosis	-0.5037719532
Mean	0.7371299342
Median Absolute Deviation (MAD)	0.031
Skewness	0.2655852126
Sum	448.175
Variance	0.001820745857
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.739	13	2.1%
0.696	11	1.8%
0.727	10	1.6%
0.695	9	1.5%
0.737	9	1.5%
0.748	9	1.5%
0.715	9	1.5%
0.703	8	1.3%
0.705	8	1.3%
0.736	8	1.3%
Other values (166)	514	84.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.644	3	0.5%
0.645	1	0.2%
0.646	1	0.2%
0.652	1	0.2%
0.653	1	0.2%

Value	Count	Frequency (%)
0.847	1	0.2%
0.841	1	0.2%
0.839	1	0.2%
0.838	1	0.2%
0.837	1	0.2%

ASF
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	314
Distinct (%)	51.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1.203597039
Minimum	0.876
Maximum	1.587
Zeros	0
Zeros (%)	0.0%
Memory size	4.8 KiB

Quantile statistics

Minimum	0.876
5-th percentile	0.9744
Q1	1.118
median	1.202
Q3	1.2975
95-th percentile	1.427
Maximum	1.587
Range	0.711
Interquartile range (IQR)	0.1795

Descriptive statistics

Standard deviation	0.1350911235
Coefficient of variation (CV)	0.1122394947
Kurtosis	-0.2205396707
Mean	1.203597039
Median Absolute Deviation (MAD)	0.094
Skewness	0.03546645827
Sum	731.787
Variance	0.01824961166
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1.19	9	1.5%
1.174	7	1.2%
1.134	6	1.0%
1.024	6	1.0%
1.202	5	0.8%
1.208	5	0.8%
1.183	5	0.8%
1.255	5	0.8%
1.184	5	0.8%
1.291	5	0.8%
Other values (304)	550	90.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.876	1	0.2%
0.881	1	0.2%
0.883	1	0.2%
0.897	1	0.2%
0.909	1	0.2%

Value	Count	Frequency (%)
1.587	1	0.2%
1.563	2	0.3%
1.535	1	0.2%
1.531	1	0.2%
1.525	1	0.2%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

First rows

	df_index	M/F	Hand	Age	Educ	SES	MMSE	CDR	eTIV	nWBV	ASF
0	0	F	R	74	2.0	3.0	29.0	0.0	1344	0.743	1.306
1	1	F	R	55	4.0	1.0	29.0	0.0	1147	0.810	1.531
2	2	F	R	73	4.0	3.0	27.0	0.5	1454	0.708	1.207
3	8	M	R	74	5.0	2.0	30.0	0.0	1636	0.689	1.073
4	9	F	R	52	3.0	2.0	30.0	0.0	1321	0.827	1.329
5	11	F	R	81	5.0	2.0	30.0	0.0	1664	0.679	1.055
6	13	M	R	76	2.0	NaN	28.0	0.5	1738	0.719	1.010
7	14	M	R	82	2.0	4.0	27.0	0.5	1477	0.739	1.188
8	16	M	R	39	3.0	4.0	28.0	0.0	1636	0.813	1.073
9	17	F	R	89	5.0	1.0	30.0	0.0	1536	0.715	1.142

Last rows

	df_index	M/F	Hand	Age	Educ	SES	MMSE	CDR	eTIV	nWBV	ASF
598	363	F	R	68	13.0	2.0	30.0	0.0	1506	0.740	1.165
599	364	F	R	72	13.0	2.0	30.0	0.0	1510	0.723	1.162
600	365	F	R	72	16.0	3.0	24.0	0.5	1354	0.733	1.296
601	366	F	R	73	16.0	3.0	21.0	1.0	1351	0.708	1.299
602	367	M	R	80	16.0	1.0	28.0	0.5	1704	0.711	1.030
603	368	M	R	82	16.0	1.0	28.0	0.5	1693	0.694	1.037
604	369	M	R	86	16.0	1.0	26.0	0.5	1688	0.675	1.040
605	370	F	R	61	13.0	2.0	30.0	0.0	1319	0.801	1.331
606	371	F	R	63	13.0	2.0	30.0	0.0	1327	0.796	1.323
607	372	F	R	65	13.0	2.0	30.0	0.0	1333	0.801	1.317

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows